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ABSTRACT 

The need for an obstacle detection system on the Mars roving ' 
vehicle was assiuned, and a practical scheme was therefore investigated 
and simulated. The principal sensing device on this vehicle was taken 
to be a laser range finder. Both existing and original algorithms, 
ending with thresholding operations, were used to obtain the outlines 
of obstacles from the raw data of this laser scan. A theoretical 
analysis was carried out to show how proper value of threshold may be 
chosen. Computer simulations considered various mid-range boulders, 
for which the scheme was quite successful. The extension to other types 
of obstacles, such as craters, was considered. The special problems of 
bottom edge detection and scanning procedure are discussed. 



INTRODUCTION 


The proposed Mars Rover which may be landed on the surface of 
Mars in the early igQo's will be required to navigate autonomously to 
reach preset destinations ^ . The possibility of remotely controll- 

ing the vehicle from Earth, as can be done in the case of a vehicle on 
the Moon, is ruled out for the Mars Rover, because the round trip 
communication time between Earth and Mars is approximately Uo minutes. 
With this much time lag it is all but impossible to control a vehicle 
that is expected to move at a nominal speed of about 1 meter/second- 
As far as possible, an optimum feasible path for the Rover 
to travel between point of landing and other points of interest on the 
Martian surface will be predetennined from the aerial maps available so 
far. However, many objects, which can be potential obstacles for 'the 
Rover, may.be small enough not to show up on the pictures. It is ex- 

t 

pected that there will be obstacles in the form of boulders, craters, 
slopes, etc., which will be small enough not to be seen. Therefore, it 
is desired that the Rover be equipped with its bwm obstacle detection 
system. 

Much research has been done and is being done on robots which 
incorporate some form of primitive "brain" and are thus able to "see". 
Unfortunately, these systems are much too complicated to be installed 
on the Mars Rover, where weight and reliability are among the para- 

9 

mount considerations. Thus, a system is being sought that will be 
simple, requiring less bulky sensors and smaller computer memory space. 
This paper discusses one such system. 
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1. HARDWARE CHOICE 

It has been decided that a laser range finder wiU be the 
primary sensing device on the Rover. The "time of flight" technique 
will be used for the determination of range. This means that at given 
time intervals a laser pulse will be sent out towards the terrain in 
front of the vehiclcj and will be reflected back from the surface it 
impinges on to a laser detector. The time difference between trans- 
mitted and reflected beams will indicate the range. 

As far as the laser range finder is concerned, the following 

3 ■ ' 

requirements must be met: 

1) Accurate enough for reliable processing, i-e, 

i . 

+ 5 cm for range error and ^ 10 arc seconds 
for angle error. 

2) Fast scan capabilities. 

3) ._.Light weight. 

4) Low power’ bonsumpt ion. 

The first two of these are applicable to the research discussed in 
this paper. The range error was taken into account by adding gaussian 
noise, with zero mean and 5 cm standard deviation, to the geometrically 
derived range values used in the canputer simulation. The angle error 
was neglected in this work, since the specified 10 arc seconds is about 
. two orders of magnitude smaller than the smallest angles used. With 
regard to fast scan capabilities, it is expected that the time required 
per range readings will not exceed 1 millisecond. Thus in ,5 seconds, 
or in the space of .5 meters traveled by the Rover, about 500 range 



readings can be obtained. This is the approxijnate number of readings ’ 
used in the simulation, where, however, it has been assumed that all 
•readings have been obtained with the vehicle stationary. This assump- 
tion will have to be re-examined in future extensions of the edge de- 
tection scheme. 

One final piece of hardware information is that the laser 
scan is assumed to be mounted on a veartical mast attached to the front 
of the vehicle, ot a height of 3 meters from ground level. This number 
may be easily changed in the simulation program, as physical require- 
ments dictate. It is felt that the success of the edge detection scheme 
is relatively insensitive to changes in the mast height, and no problems 
should arise as a result of it. 
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2. PROBLEM DEFINITION 

2.1 Objectives of Simulation vs. Implementation 

Throughout this paper^ the distinctions between simulation 
objectives and implementation objectives' should always be kept in mind. 
The steps involved in simulation are as follows: 

- (a) A realistic terrain model, including the obstacle 

or obstacles to be detected, must be envisioned and 
mathematically modelled. 

(b) The range values must be generated, based on the 
geometry of the model (see Section 2.2). 

(c) Thresholds to be used in the edge detection 
algorithms are calculated. 

(d) Expected values of noise in the laser measurement 
process must be added to the range values. 

(e) Algoritlims are then used to operate on the noisy 
TEinge measurements to obtain an outline of the 
obstacles, based on the pre-selected thresholds. 

The end result of this .process is an evaluation of the quality of 

reproduction of the edge of the obstacle, for differing combinations 

of threshold choice, algorithm choice, and scan angle choices. 

In the Implementation, the procedure for the on-board computer 

' is: ■ ■ , ■ ' 

(a) Obtain the noisy range values from the laser scan, 
where the scan angles have been determined from 
the simulation results. 

(b) . Operate on these values, using pre-stored algorithms 

and thresholds (or procedures for finding thresholds) 
selected as optimum from simulation results, to de- 
termine the size and location of any obstacles. 
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The end result of this process is a path selection decision 

The research presented in this paper, while interesting in 
itself, was primarily directed towards realization of the final system, 
In'this respect, emphasis has been, placed on obtaining results in the 
areas common to the simulation and implementation, i.e., threshold and 
algorithm evaluation. The preliminary work should therefore be seen 
as just that - steps leading up to this goal. 

2.2 Geometrical Considerations • 

Figure 1 illustrates a simplified picture of the Mars Rover, 
with a positive obstacle (one that projects above the groimd level, 
such as a boulder) directly in its path' of travel. The Martian surface 
is taken to be perfectly flat here and in all simulations. One reason 
for this choice is to simplify calculations and to limit the number of 
independent variables in this prelijninary development. In addition, 
research is currently being carried on in the development of a terrain . 
modeling procedure, ^ where sloped terrains are being considered, 
so it was not felt necessary to duplicate this effort until the edge 
detection scheme becomes more refined. 

As shown, 3 (the elevation angle) is defined to be the angle 
between the laser beam and the normal to the laser mast, 9 (the azimuth 
angle) is defined to be the angle between the laser beam and the line 
representing the Rover’s direction of travel, and b is defined to be the 
horizontal distance from the laser mast to the center of the. obstacle 
(when such a center point exists). 

The obstacle considered for most of this work was a hemi- 




Beams 

(b) Top View 
FIGURE 1 


Scenario of Problem Studies 
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spherical boxUder of radius r, whose center was located on the ground, 
directly in the vehicle's path of travel, at a horizontal distance of 
b meters from the laser mast. In order to generate the range values, 
as functions of b, r, (3, and 0, a more detailed geometry was defined. 
Referring to figure 2, the origin of the x, y', z axes is located on 
the ground directly below the laser, which is the point (0,0,3) there- 

I 

fore. The origin of the x, y, z axis is located at the center of the 
boulder, so that (0,0, 0) in the x, y, z frme is the same as (0,b,0) in 
the X, y', z frame. The beam from the laser to the point of impinge- 
ment on the boulder if , and the radius from the center of the 
boulder to the point of impingement is r. The other variables are in- 
troduced merely for convenience in the calculations. 

Assuming the laser beam has hit the boulder, the following 
equations enable us to calculate the range R, : 


X sin 0 

z = Rg sin (3 

R - 3 _ __ R 

^2 " sin 1 

Substituting (3) into (2) 


(1) 

( 2 ) 

(3) 


z = 3 - R^ sin ^ 


\y2 = ^2 P 


R 


3 


- R 


xy2 tan {3 xyl 


= J(y+h)' 


R T = .1 (y+b)^ + 
xyl 


(4) 

(5) 

( 6 ) 

(7) 
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Eutstituting (3), (6), and (T) into (5) 

(y + cos p (8) 

Manipulating (8), we find that 

y .= Rj^(cos^p - sin^G) - 2bR^ 

The equation of a sphere is: 

. 2 22 2 ■, 

X + y + z r (10) 

Squaring (l), (2), and (9), substituting into (10) and simplifying^ 

(- 2 b\J^s^^ - sin'^G - 6sin[3) + (b^ + 9 - r^) = 0 (ll) 

This is a quadratic equation in R^^, and one of its solutions (the smaller 
one of course^ since the larger solution indicates that the laser beam 
has passed through, the sphere and contacted the surface on the other 
side) is the range value we are seeking. Rotice that ve have the de~ 
.sired functional dependence on b, r, fij and 0. 

The other possibility is that the laser beam hits the terrain 
surrounding the boulder. In this case the range is actually independent 
of 9 (and, of course, b) and is simply expressed as. 


12 2 2 
'cos p - sxn 0 + b 


(9) 




3 

sin 8 


( 12 ) 


At this stage, by specifying b and r, and by sweeping p and 6 through 
limits to include the entire boulder, we can generate a matrix of range 
values. These values are the input to the edge detection algorithms. 



10 . 


3. EDGE DETECTION SYSTEM 

3.1 The Scan . . 

The ranpe data z. . (composed of the geometrically derived 
values given by equations (11) and (12), plus the additive Gaussian 
noise term) which is obtained by varying the angles p and 6, can be 
stored in computer memory in a matrix form with the elements ordered 
according to the values of p and 6. The value of © changes along each, 
row with the index J, while the value of p changes along each colunui 
with the index i. This matrix Z, called the measurement matrix, forms 
a range image of the scene ahead. In contrast to a photographic image, 
where the elements of the image are functions of the brightness of the 
scene, the range image consists of dist^ces of the points on the scene 
from the point of measurement. The measurement matrix is thus represent- 
ed as: 



Once aga;in, the values in this matrix will all be directly measured by 
the laser range finder and stored in the on-board computer in the 
actual operating system. 

3.2 The Sharp Changes in Range Readings 

Whenever adjacent elements of the measurement matrix ore 1 
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taXen from the scune terrain feature, e.g. several neighboring points on 
a flat terrain or several neighboring points on the side of a relatively 
continuous obstacle, then the range readings of. these points will vary 
only slightly from each other, especially when the differences in 
elevation and azimuth angles measured from the laser to the points is 
small. And in the case of two or more points on a flat terrain with the 
same elevation angle, the range readings will be exactly the same (dis- 
counting noise), as shown by equation (12). However, adjacent elements 
which straddle the edge of an obstacle (one measuring the range close 
to the obstacle's edge, and the other measxiring the range to the terrain, 
with this latter beam passing just outside the obstacle's edge') often 
•exhibit sharp changes in range, which can be used to indicate the presence 
of the edge. This physical property is the basis of the edge detection 
scheme. 

A"ineans is required to bring out or enhance these sha.rp changes 
in range readings, in order to recognize the edges. Therefore, algorithms 
were sought whicli involved fairly simple manipulations of the range values 
(to minimize computation time required by uhe small, on-board computer, 
so that path selection decisions can be made as soon after deteimination 
of the range image as possible), evaluated a test point in relationship 
to, its four surrounding "neighbors" in the range image (so that an edge 
in any orientation near the test point would be detected), and ended with 
a thresholding operation (to provide the necessary numerical cutoff in- 
dication between the presence and absence of an edge). The success of 
the algorithms depends on the quality of the enhanced edge, once the 
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optimum thresholds have been selected, and on the relative ease with 
which the proper thresholds can be selected. 

30 Algoritlims Used 

Based on the preceding criteria, the following two algorithms 
were selected for use in the simulations, Their merits and drawbacks 
will be discussed and illustrated. * 

7 

(a) Normalized Laplacian ' 

A new matrix Q can be obtained by, the following operation 
on the range values: 


z. .-f-z.,., . ,+z. ..v-4z. , 

s i-ljJ i+l>»l i;J"l ijJ-H 

" Z. T .+Z.,T .+Z. . I+Z. 

1-1; 0 1+1; J 1;J-1 i; J + 1 

(b) Four Directional Ratio 

A new matrix S is obtained by operating on the range 

values as below: 


(lit) 


s. . 


T z. z.^.n z. . _ n . z. . - n 

= 1 (_^) , . (^) (^) 


Z . . 

1;D 


Z. . 
1;3 


(15) 


'i; J 


1; J 


The Normalized Laplacian is from the existing literature, while 
the Four Directional Ratio was developed specifically for this application. 

Q 

3.4 Analysis of the Algorithms 

The pur^Dose of this section is to develop a procedure for 
choosing the proper values of threshold for each algoritlim, given the 
type of irregularity to be detected, and to analyze the effects of noise 
on, the measurement data for a determination of how large the statistics 
of noise can be allowed without leading to false alarms. In order to 
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reach these two objectives, each contribution to the range measurements 
will be derived separately. 

Let 


(16) 


z. . = r. , + V. . 

^>3 

where r. . is the true range measurement, v. . is the additive noise 
term, and z. . is the resulting range value as measured by the laser 
rangefinder. 

Also let 

where a. - . indicates the fractional change in true range at point 
(i-ljj) with respect to point (i,j). Similar expressions are defined 
for points (i+1, j), (i,j-l)j and (i,j+l), with, corresponding ^ , 

a. . V; a. . , - . 

i,j-r. 1,04-1 

From equations (l6) and (IT) one can write 


"z. , . = (1 + a. , .)r. . + V. , 
1-1,0 1-1; 


(18) 


It follows that the measurements z.,_ '.j z. . and z. . . can also 

1+1,0 3-,0"i 1; 

be expressed in terms of r. . and the associated noise, terms. 

For the Normalized Laplacian algorithm, using equations (l4) 


and (l8), 

q. , = 1 - 
IjO - 


4r. . + 4v. . 

iiO • ^>3 


TO+JT"! .-f-a. , .-Ki. . ~^<x. ” 7)r~ .+(v. T .•'■V.,' TV. TTTvl . , , ) 

'■ 1-1,0 ll-liO 1;J-1 liJ^l 1;J 1-1;0 1+1,0 1,0-1 1>0+1 


Dividing numerator and denominator of the fraction by J4r. 

1; 3 



0.4, 


<1,- 4=^1- 


1 + (Iki) 

'r. . 


l+T-(o:. , .+Q:. . T+a. . T )+ i(-- ■■ ?-J .. J . . k -kkti) 

4 1 - 1,0 1+1^ J 1^0-1 i^J+1^ V r. . r. . r. . r, . / 

J J J ijO 

(19) 


In order to investigate the threshold requirements of q. let us assume 

1 ^ 0 

there is no noise, i.e., v. ■ = 0 for all i and J. Q'hen, from equation 

j 

(19). 


* t 

q. . = 1 - 
1 . J . 


1 + 


1 


( 20 ) 


^ (a. ^ . + a. - . + a. . _ + a. . ,) 

4 1-1, j m,a 1,,'j-l 1,0+1/ 


The fra.ction term above can be expanded in a geometric series, with the 
higher order terms being dropped since the alpha values are all very 
small. This results in 

it • - 1 - [l - r (a. n . + a. , . + a. . , + a. . 

i,0 ^ . 4 1-1,0 1+1,0' 1,0 ”1 1,0+1'J 


= T? " Vl,d (21) 


In this form, equation '(21) can be used to select edge detection thres- 
hold values. for the Normalised laplacian Igorithm, given the type of 
discontinuity to be enhanced. Demonstration of its usage will be given 
in an exajnple at the end of this section. 

Returning to equation ( 19 ), the effects of noise can be studied 
by setting all a ^ 0 , so that the 0 .aser scans five points nearly 
equidistant from itself (the inside surface of a sphere, with the laser 
at the center, maybe imagined). Then, 
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1 + (^) 




1 + i 


^i+l 


f ll ^ j *~1 ^ j 


Expanding the fract-ional term in a geometric series as before 

X - (1 + -i^) [i - r (23) 

X, j ^ r. / I U r.. r. . r. . r. . J 

Multiplying this out, and dropping higher order powers of the noise terms 


(which are small), 




V. . - V. T . V. , . V, . - V. 

3.^ J + 1 ( + 3.-t-l,J ^ ^ 1; Jtl ^ 

r . . r. . r. . r . . r. . ' 

1/0 . 1,0 1,0 1,0 1^0 


A single quantity which is a useful measure of the effects of all five 

noise terms is the varijuice of q^ . , which is defined by 

ij J 

var(q{^P . E -m)2| . I 


where m *= - E 


R.j = 


the mean value of qC . 

1^0 


Assuming that the noise v associated with each measurement is independent 
(so that the variance of the sum equals the sum of the variances), zero 
mean (so that each m = O), and has the sane standard deviation CT , the 


variance of qt . is: 

i.J 


var ( q . . ) = 
0 


2 


+ U (- 


(T^ s ^ 5 (X ^ 

I6r^ .. ^ l.r^, . 

1;0 1;0 


Equation (26) can be used to detemine how large a standard deviation 
may be tolerated v/ithout adverse effect on the reliability of the edge 


detection algorithm. Refer to the example at the end of this section. 



The same type of analysis can he performed for the Four 
Directional Ratio algoritlim. Utilizing equation (iB), and examining 
the first, term of equation (15); 


z. , . n 

= 


(1 + a. . .) r. , + V. , . 


r. . + V. . 


n 


■ (27) 


Dividing numerator and denominator by r. .,3 


z, - . n 

(-^) = 
1;0 




n 


(28) 


For the case of no noise^ i.e.; all v. . - Oj equation (28) becomeSj 

0 

z. ^ . n^ n 

(_iri^) = (1 + a ) 

1 :1,0 


(29) 


And neglecting the higher order terms of the polynomial expansion, since 
a is small, 

~ 1 .^ n a.. . (30); 

z. . 

- . 

If the same manipulations are performed on the other terms of equation 
(15), then an expression for the entire algoritlim in the absence of noi'je 
is approximately. 


1 + ? (a. , , + a. ^ . + a. . T + a. 
i,j ^ i“l; 0 


(31) 


This equation is analagoxis to equation (21). 

Returning to equation (20), if only noise is being considered, 

so that all a — 0, then 


n 


z. , , n* (1 + V /r ) 
/ i-l,3's J r , j 


( 32 ) 
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The, numera.tor of this expression can be written as a polynomial ex- 
pansion, and the denominator as a geometric power series. Neglecting 
higher order, terms, we are left with, 

^ (1 ^ n / . n /r_ ) 

. j J- -Ly l 0 <3 

V. ^ . V. . ^ V. ^ . V. . 

= (1 + n — - n .J^) 

r; . r. . r. . r. . 

i^ J t, j 1, j i, j 


( 33 ) 


Extending this result to all terms of equation (15), 


^ 1 + "(liM + .1 . + _ n lii 

3.^0 4^ r. , r. . r. . r. . r. . 

1, i 1, j 


V. . 

J 


V. . 

-jJ: 


V. . 

J 

ifO 


- ^ (^)(-^.iLi H- + liiji) ■ (34) 

3-^ij 1; j J 3., J i»J 


And dropping the products of noise terms. 


V. 


V. 


V. 


V. 


sf . = 1 + " + Ikl-1 + n liJ. 

,i;J ' 4 ^ r. . r. . r. .. r. . ^ r. . 

^^0 3.,J 3-^0 3.,J ijO 


( 35 ) 


Under the assumption of independent, zero mean noise with standard 
deviation O' , an expression for the variance of . follows as.be- 

3., j 


fore, 


2 2 

var(s^ ) = 4(' ^ ^ ■) + n^ 

I6r^. . ^ 

3., J 


O' ^ ^ 5n^ (T ^ 

r . . 4r^ . . 

i;3 1,3 


( 36 ) 


This equation is analo.gous to equation (26). 

The foregoing analysis gives the means of cl^oosing the proper 
thresholds, given the values of a. For example, if two of the outer 
points (i-l,j) and (i,j-l) lie outside the obstacle and the other three 
points, including the central point (i, j), lie on tiie obstacle, then one 
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may assume that a. - .» a, . _ ■> 0 and a. ^ a. . _ C=i 0. 

, 1-1, a i,J"l ^ 1+1,0 1,0+1 

To generate some typical numerical results, let 

Cf . ~ a o.oU (37) • 

X-0., J X, J-X 

Then for the Normalized Loplacian algoritlun, from equation (21), 

qt . = i (0.04 + 0 H- 0.04 + 0) ^ 0.02 ( 38 ) 

1, 0 ^ 

Thus, the threshold may be set just below 0.02 if the point in consideration 
is to be recognized as lying just inside the edge of the obstacle, i.e; 


T . ci 0.019 
qi 


(39) 


Similarly, if three of the outer points, including the central point (i, j) 
lie outside the obstacle, and the other two points (i+l,j) and (i> j+l) 
lie on the obstacle, then we might take, 


a. . . a. . , ei 0 
1-1,0 i,J-l 

a. ,n J 2 S. 0 ;. , csi -0.04 

1 + 1 , j i,j+l 


Equation (21) now becomes, 

q* . = i (0 + (-0.04) + 0 + (-0.04) ) = 
1 , J ^ 


- 0.02 


( 1 . 0 ). 

( 1 . 1 ) 

(42) 


so that the threshold may be set near this number if the point in con- 
sideration is to be recognized as lying jiist outside the edge of the 
obstacle, i.e., 

T C=L -0.019 (43) 

qo . 

In the case of the Four Directional Ratio algoritlim, using the same 
alpha values, we have from equation ( 3 I), 
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s? . = 1 + ? (0.04 + 0 + 0.04 + 0) = a + n(0.02) (44) 

, J " 

for an inside edge 

s? . =1 + ? (0 +(-0.04) + 0 -h (-0.04) = 1 - n(0.02) (4?) 

3 ^ 

for an outside edge 

Notice that by increasing n we can amplilV the a.pi>arent threshold values^ 
and that for n = 1 the thresholds are the same (mthin a constant) as 
those for the Nonnalized Laplacian aJ.gorit}im, i.e. 

~ ^ ¥r . . . ' 

s. . = q. . + 1 for n = ,1 ' (46) 

0 ij J 

Computer simulations were run using n = 1 and n = 2, the first case being 
used as a check for agreement to the Nonnalized Laplacian algoritfim re- 
sults and the second case investigating the possible improvements in 
perfomance obtainable by increasing n. 

The two sets of thresholds are therefore, 


for n = 1 


for n = 2 


■^si 

1.019 

for 

an 

inside edge 

(1*7) 

•n 

.. SO 

.981 

for 

an 

outside edge, 

m 

T . 
SI 

1.038 

for 

an 

inside edge 

(1*9) 

SO 

.962 

for 

an 

outside edge 

■ (50) 


The true values of alpha may be practicably obtained from a physical 
model of obstacles arid terrains that may presimably be encountered on 
Mars. By examining different types of configurations in ' simulations, 
we may predetermine the specific values of a3-pha to use for threshold- 
ing in each case. , . , 

The variances given in equations (26) and (36) afford us an 
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indication of how lar^e a measuranent noise may be accommodated by the 
algorithms. Suppose it is desired that the threshold lies outside the ' 
i O' limit of tlie variations in the algorithms. For the Normalized 
Laplacian algoritiim, from equations (26) and (39)^ 



G-i 0.017 r (51) 

With this value of O' we will have approximately 70 *^ certainty regarding 
the accuracy of the detections. Obviously at longer ranges, higher 
measurement noise may be allowed. 

For the Four Directional Ratio aJgoritlira, keeping in mind that 
we a, re comparing' the statistics of noise to the variations in threshold, 
ve have from equations (36) and (kk), , ■ ' 



(J:^ O.OIT r. . - (52) 

-*-> j 

This is the sarne bound on O’ that was found for the Normalized Laplaciiui- 
algoritlva. Since both the threshold values and the noise effects are 
increasing linearly with n according to this analysis, there is no 


t 



apparent merit to be derived from changing n in this algorithm^ i.e., 
no improvement in the quality of the enhanced edge. ■ This conclusion 
will be checked in the computer simulations V7hich follow. 
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4 . COMPUTER SIMUUTION PROGRAM 

Now that a rtiathematical model of the edge detection problem 
has been establislied, and analytical procedures proposed for implement- 
ing the schemej a computer program is needed to carry out the simulation. 

Such a prograjii vras developed for this purpose; a flowchart of the steps 
involved appears in figure 3. 

Several features of the program should be, noted: 

1 ) In generating range values which lay on the boulder, 
it was necessary to' use the double precision option 
on the IBM 360-50 computer. The reason for this is 
seen by examining equation ( 11 ) closely. The trio- 
nometric functions of p and 9 in this expression are 
calculated by means of a Taylor series in the ccmputef. 

. Since the angles involved are so sinoll, and the 
differencesbetween the angles are at least an order 
of magnitude smaller stiU. (approaching O.l^ai: 0.002 
radians), it is desireable to have the greatest 
possible accuracy in determining the sines and cosines. 

It was found experimentally that single precision 
sometimes led to significant errors in these range 
vtd.ues, which is unacceptable since the errors in the 
geometric range data should be at least an order of 
magnitude smaller thtUi the standard deviation of the 
Gaussian noise added to the. data in order for the noise 
to be physically meaninglTil. Thus, double precision 
was needed to achieve range values accurate to id.thin 
+ ’^5 m at least. Longer CPu times were required for 

I 

double precision in the simulation; however, on the . ( 

actual Mars Rover the range ; readings will be measured 
■ rather than calculated, so .tliat the additional computer ■ 

time for this step will not be a factor in the on- 
board canputcr. t 
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FIGURE 3 

.Flowchart of Computer Simulation Main Program 








Two of the variables in this prograjn are the number 
of different elevation angles and the number of 
different axirauth angles to be scanned. The product 
of these two values equals the total number of points 
contained in the measurement matrix, vrfiich, along with 
the angle limits, is. a measure of the ".resolution" of 
the range image. As discussed previously, it has been 
assumed that each range measurement by the Rover will 
take approximately 1 msec to complete. In the smul- 
ations which follow there are a total of 5^5 points 
in tlie range image .(^5 separate elevation angles and 
21 separate azimuth angles). TJierefore., under nominal 
conditions, the Rover would require approx ima.tely 1/2 
second to record all these range values., in which tune 
it would travel approximately l/2 mcte:r. The effect 
of this motion on the algoritlmis has been neglected, 
wiiich at first may seejn to be rather a severe assumption. 
On the other hand, when operating on the range values 
for the puipose of edge detection, only five neighbor- 
ing points in the measurement matrix are compared at 
■any one time. If the laser beam scans the terrain 
ahead in a W-shaped pattern, then these five measure- 
ments v/ill be taken within a few milliseconds of each 
other. In this light, it was deemed, acceptable to 
neglect the vehicle's motion; it will be left to future 
research efforts to investigate its effect. 

The limits on the angles also warrant some discussion. 
For the most part these limits were chosen with the 
a priori knowledge of the size and location of the 
obstacle, so as to maximize the infoiraation received 
for edge detection. This is a very contrived situation, 
and illustrated part of the complex problem of scann- 
ing scheme determination, which will be examined in 
Section 6. 



4) ' Thresholds used in each algoritlun were chosen off-line^ 
once the alpha matrices for the simulated terrain were 
calculated and printed out by the computer. This is 
considered to be a valid procediire, since it is not 
now expected that the Rover will be capable of adapt- 
ively choosing thresholds for edge detection^ but 
rather will use pre-stored values (based on simulations 
much like this one) as a basis for its decisions. 



5 . SIMLTMTION, RliiSULTS FOR BOULDERS 
5-1 The Boulder at 3O Meters 

The initial computer simulations were conducted for the case 
of a 1.0 meter radius hemispherical "boulder located 30 meters in front 
of the Rover. These mimbers were selected so as to provide a true 
obstacle that had to be detected and avoided (since physical limitations 
on the vehicle prohibit it from navigating over a discontinuity of more 
than about .5 meters under nomal conditions) and to place this obstacle 
at a typical mid- range location at which edge detection by means of 
range data manipulation becomes most important for path selection 
decisions.. 

Figure ^ illustrates the resulting computer-generated range 
images. The upper matrix rei^resents the geanctrically derived, un- 
distorted measurements, and the lower matrix represents these some 
values when contaminated by zero mean, 5 cm standard deviation, 

Gaussian noise, ' Thus, the lower matrix simulates the range values that 
will be obtaiiied by means of the laser rangefinder on the Rover. In 
both cases the outline of the boulder has been drawn, in its approximate 
location, to clarify for the reader how the scanning procedure will 
operate. The exact angles used, and their orientation on the range 
image, can be dcteimined from the data listed at the top of the page. 

As outlined in Section four (x parameters can be defined 

for each element of the undistorted range image, ;md so four a matrices 
CEUi be found to describe the entire range image. Figures 5 and 6 de- 
pict these four matrices, which are used in the off-line determination 
of threshold values by the procedures discussed. As an exajiiple of the 
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50.01 
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44. I 3 
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39.41 
38.35 
37.07 
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33.72 
J2.80 

31.80 

31.01 
30.22 
29,49 
28,75 
27.97 
27.48 

26 . n 

26. 12 


approximate thresholds to be expected in cases like- this one, and to 
show agreement with the anaJLysis given, a threshold of 1.02 was used in 
the Four Directional Ratio algorithm (with n = l) to pick out the points 
close to the inside edge of . the boulder, and a value of .96 was used to 
pick out the points close to the outside edge. 

Applying the two algorithms (the Four Directional Ratio with 
n = 2 and the Noimalized Laplacian) to each of the measurements con- 
tained in the noisy range image (except for the extreme top and bottom ' 
rows, and left and right columns, since none of these measurements has 
all four of the associated neighboring points defined in the algorithms)- 
yields the two edge detection matrices pictured in Figure 7. It should 
be noted that the range measurement noise being sinulated has virtually 
no effect on the elements of these matrices, since from equation (51); 
for r. . oi. 30 ; we have that (T allowable ^ .OI7 r. ct . 51 , where- 

.X, j 

as the standard deviation of noise used is only , 05 . .This indicates 
that, with the accuracy of the laser rangefinder as assumed, the edge 
detection sch»j:me is quite insensitive to noise, which is a very en- 
couraging conclusion for this aspect of performance. 

Finally, in Figure 8, we see the outlines of the boulder 
. after the thresholding operation has been applied to the previous 
matrices. The outcome obtained by means of the Four Directional Ratio 
algorithm with n = 1 has been suppressed in this and all subsequent 
figures to avoid redundancy, since the results are nearly identical 
to those of the' Normalized Laplacian algorithm, as expla.ined in 
Section 3.J1 and proven experimentally. In these pictures an "x" re- 
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FIGURE 7 

The Edge Detection Matrices for a Boulder at 30 m 
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FIGURE 8 

Outlines of the Boulder o.t 30 m 



presents a detected inside edge point (one that lies close to the edge 
and is on the obstacle) and a represents a detected outside edge 
point (one that lies close to the edge, as seen from the laser, and is 
on the terrain). The true edge, therefore, lies between the sets of 
these two "near edge" points. As is evident, by proper choice of thres- 
holds both algorithms yield pictures which are quite good representations 
of the boulder’s edge. It was expected that the Four Directional Ratio 
algorithm with n 1 would not result in a more complete edge than the 
Normalized Laplacian algorithm, based on the argument at the end of 
Section a trend of this type was noted in the simulations. 

More conclusive evidence could have, been obtained if n was increased 
beyond the value of 2, but no such tests were run. This point must 
ultimately be investigated and resolved before a final algoritlyn, choice 
can be implemented. 

Due to the nature of the algorithms, the fact that the bottom 
edge of the boulder is not detected is a characteristic outcome and 
should be expected. In other words, since the edge detection scheme 
is based on the search of neighboring range elements for sharp changes 
in their, values in order to locate an edge, there will be no such in- 
dication, if the adjacent measurements are approximately the sajne (as 
they are for points on the same terrain feature and also for points 
near the bottom edge). A different type of algorithm is therefore 
needed for this special case. Further discussion on this subject can 


be found in Section 



34 . 

5.2 other Mid-Range Boulders 

Since the laser rangefinder will' be required to provide in- 
formation about the terrain in the entire mid-range field (approximately 
3 to 30 meters in front of the Rover), the edge detection scheme was 
tested for boulders located at distances other than 30 meters. It was 
decided that boulders located at 10 m, 2CJ m> and 4o m, in addition to 
the one located at 30 m, would be suitable for determination of the 
capabilities of the edge detection’ algoritlims. 

The range images and boulder outlines of these three addition- 
al cases appear in Figures 9 through l4. By proper choice of scanning 
angle limits and threshold values, all outcomes are equally satisfactory 
(except for the continued lack of bottom edges). Tiierefore, this type 
of edge detection schejne is considered a viable procedure for recognition 
of mid— range positive obstacles, ^ 

5.3 The Bottan Edge 

As xt has been pointed out, all the boulder edge outlines 
seen thus fai have been without a bottom edge, due to the. nature of 
the ejrhancement 'algoritfvns. In order to determine the size of an 
obstacle, and so how much of a potential hindrance to the progress, of 
the Rover that it rejrresents, it is considered important to develop an 
alternate scheme to detect this bottom edge based on the laser’s range 
measurements. 

The first attempt at a solution to this problem was founded 
on the observation (which can be easily proven geometrically) that 
range values measured to the bottom edge itself form a set of local 



FIGURE 9 

The Range Image for a Boiilder at 10 
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FIGURE 10. 

Outlines of the Boulder at 10 m 



The Ran^e Image for a Boulder at 20 
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FIGURE 12 

Outlines of the Boulder at 20 m 



FIGURE 13 

Tlie Range linage for a Boxilder- at hO m, 
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FIGURE l4 


Outlines of the Boulder at 4o m 





maxima compared to the ranges slightly above and slightly below them in 
the range image. For the case of the 1 meter radius, hemispherical 
boulder, located 30 meters from the Rover, Figures I5 and I6 detail the 
"before" and "after" outlines of the boulder. Note that the scaling 
of the computer printout has been changed from that of Figure 8 , to 

show the outcomes more clearly. Although only a few bottom edge points 

« 

(seen as are available in Figure 16, these are really all that are 

necessary to provide an indication of the complete bottom edge for the 
purpose of size determination. This scheme would seem to perform 
satisfactorily; however, it was the noiseless range values which were 
being compared in order to find the bottom edge in this case. When the 
more realistic noisy range va].ues are used in the comparison, the result 
is as in Figure 17 ; the picture in this case is obviously unacceptable. 

The explanation for the degradation in performance . is that the ?*ange values 
measured to the bottom edge are no more than .01 meters larger than their 
ad;jacent elements in the range image, so that the standard deviation of 
noise of .05 meters completely obscures this difference. 

In seeking a more noise-resistant scheme, the following pro- 
cedure v/as developed. By examining each range value lying along the 
center of the measurement matrix (which corresponds to an aximuth ' 
angle of zero, directly in the Rover's direction of travel) and com- 
paring them to the range readings that would be tai^ne if the boulder 
were not present, the bottom edge point for the center column of the 
range Image can be detected if a given element nob "close" to the 
range withoirt the boulder (given by equation ( 12 ), r. . = 3 /sin( 3 ) and 
the element just below this one is "close" to the range without the 
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FIGURE 15 


Expanded Scale - The Boulder at 30 m 
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FIGURE l 6 

The Bottan Edge of the Boulder at 30 m - No Noise 
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FIGURE 17 

The Bottom Edge of the Boulder at 30 m - With Noise 



boulder. Bv "clncn" , « 

of ,oi„. 

the range without the boulder wm i 

... . as anything between- the 

of (3/sinf3^ + ^ rr «-!_ 

V • this bottom edge point is found, we 

may use a linear inteipolation to fill in Jh , 

^ edge between this point 

>^e two points on either side of the boui.der dete.™ined by the 

. Closest to the bottom.. 

Keturning to our example Of the boulder at 30 meters,, the 

i'ange values used for tlvic: 

„ ^ are listed in Table 1 

hITb ^ ’ 

eta, THLIA), does not fall within the limits of (3/sinp) + 3 (j 
- cr the headings of Mpp ^ 

-.1 the range measurement does fall within these l.„its: Therefore, 
e bottom edge , point, is loeated in the center of the range image at 

l:>oulder that can be ceen by means of 
the edge detection algorit,.s are indexed (l,,,) and (l,,l,) . 3 . ,, . 

.-tng these three points with two vertical lines (for the sides of the 
er) and one horizontal line (for the bottom of the boul.der), we 

excellent, a serious practical problem can be envisioned, if 1,3 terrain 

front Of the boulder is not as flat ^d smooth as assumed, for example 

^ ere are sane small pebbles on the terrain directly in front of the 

oulder, then it Is obvious that the bottom edge scheme iust outlined 

vm very lively gi.e a false indication. This procedure must there- ' 
fore be considered unfeasible, 

<m edge problen mil have to be approacliod by a completely 



TABLE 1 


Range Values Used in Bottom Edge Deterainat ion 

RANGE VALCeS .LS£0 FOk BOTTUM EDGE ALCCRITHM 


bEfA rilN = 3.0 DEGREES 

oSTa I MC r. r = .15 UEGktcS 

BETA = BETA MlN + a-i)-H£rA ‘MCKEMENT. 

THcTA = 0,0 DEuREcS {DIRECTLV IN FRONT C'F MARS ROVEkJ 


Rvj03(6ETA) = 


BOLLCER 'PkE'SEKTr 


RwOi ( BET 
R/iuB ( bET A J 15 = 
RW d ( BE T a t THE T A ) = 


tkue range from lase«. to the ground* without the 

AS A Fa.\CTIC:V CF BETA CNLV < = 3 - 0 /S I N ( 3 E TA ) 1 

= Tk'J= range rlTnnUT ThE eCuLDER, PLUS 3 *(STANDARl 1 CcVIATiCN CF NGISE) 
Tr\uc aiTHCUT THt BCULUlk* MINUS 3=!' ISTaNDARD Dc V I AT I UN CF NO I F 

LASEk, with The BGULCER PRESENT, 
function of seta and theta 


range from 
as A 


1 ' oc TA 

1 3.00 

_ 2 3.15 

3 3.30 

A 3.A5 

5 3.60 

.6 3.75 

7 3-SiJ 

8 4.05 
’ 9 ■ 4.BJ 

10 4. A 5 

11 _ 4.50 

12 ■■ 4.65 

13 4.30 

14 4.55 

15 ■ '5.10 

16 5.25 

17 5.40 

18 5.55 

19 5.70 

20 5 .35 

21 ■ 6. CO 

22 6.15 

23 _ 6.30 

24 ■■ ■■'6.A5 ■■ 

25 6.60 


R-MJSI 35 Ta ) 

57.25 
54.63 
52.13 

49. as 
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44 . ii 
A2.50 
40. 9A 
39 . 50 
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37. U6 
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32. 75 
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29. A4 ' 
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26. 13 
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3 i . 2 i 
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FIGin^E 18 

The Intei-polcited Bottom Edge for a Boulder at 30 m 



different method. The use of gradient comparisons seems like the next 
logical step, and this is the direction that will be taken in future 
research efforts. 



6. SCANNING SCIEME CONSIDERATIONS 


To this point the scanning angle limits have been chosen with 
the a priori knowledge of the boulder's size and location, so that, for 
a fixed number of elevation and aximuth angles to be scanned (i.e., for 
a fixed munber of elements in the range mage), the angle differences 
between the range points were as small as possible, in order to maximize 
the information received about the boulder and its inunediate surroundings 
The geometry defining the angle limits for this variable scanning pro-, 
cedure is illustrated* in Figure I 9 . Based on this drawing, the follow- 
ing equations can be derived. 


6 . sin ^ 

min 


3/b^ 9 - - br 


2 

b + 9 


( 53 ) 


(3 = t an 

max 


-1 


b-r 


( 54 ) 


9 




max 


e . = e 

min max 


( 55 ) 


m 


As expected, these equations exhibit functional dependence on b and r. 

A compilation of these angle limits for a number of different 
size and location boulders was' then generated, and the results are 


listed in Table 2. The colrunn headed "Extreme Theta" refers to the 

magnitude of cither 0 or 9 . since they are the same; the sign of 

min 

these limits is as defined in equations ( 95 ) and The additional 

columns headed "Max Range" and "Min Range" give a measure of the limits 
on the range' measurements necessary to detect these various mid-range 



TABLE 2 

R^ge and Angle Linits Calculated 


OIST 

RAO lU.S 


MIN 9.ANG 

10.0 

0-25 

11.35 

10.20 

10.0 

0.50 

12. 44 

9.96 

1 0 . C 

0.75 

13.77 

9.72 

10. c 

1.00 

15.44 ! 

. 9.49 

10 . 0 

1.25 

17,53 

9.25 

10.0 

1.50 

20-44' 

9.01 

10 . c 

1.75 

24.44 

8-78 

10. G 

. 2.00 

36,44 

8.54 

20.0 

0.25 

22.04 

19. 93 

20. C 

■ 0.50 

24.22 

■ 19-73 

' 20 . 0 

0 .75 

26.59 

■ 19,43 

, 20 . C 

1-00 

30.22 

19.24 

20. C 

1-25 

34.51 

18- 99 

20. C 

1.50 

40.22 

13 -. 74 

20 . C 

1-75 , 

48.22 

13-49 

20.0 

2.00 

60.22 

lB-25 

30-0 

0.25 

32,86 . 

29-90 

30- C 

0.50 

36,15 

29.65 

30.0 

0 .75 

40. 15 

29,40 

30. C 

1.00 

4 5.15 

29.15 

30. 0 

1.25 ■ 

51.58 

28.91 

30.0 

1.50 

60.15 

23.66 

3 0 . G 

1.75 

72.15 

28.41 

30 . C 

2.00 

90-15 

28.16 

<^0 . 0 

0.25 . 

43- 75 

39. 36 

40 . 0 

0.50 

43.il 

39.61 

40 . 0 

0.75 

53.45 

39. 36 

40 . C 

1.00 

60.11 

39, 12 

40 . 0 

1.25 

6 8 - 0 3 

38.87 

40. C - 

1. 50 

80,11 

36-62 

40 .0 

1-75. 

. 96.11 

3F.37 

• 40.0 

2.00 


38-12 


for Variable Scanning 


N BETA 

MAX BETA 

EXTREME Tl-ETA 

15. 33 

17.10 

1.43 

13. 95 

17,53 

2.37 

12'. 53 

17-97 

4.30 

11.20 

IS. 43 

. 5.74 

9. 32 

18.9? 

7,13 

8. 44 

19.44 

3.63 

1 

o 

19.93 

10.93 

5.66 

2 0-56 

11.54 

. ' 7, 82 

8.64 

0.72 

7. 11 

8,75 

1.43 

6. 41 

' 8 . S 6 

2,15 

5. 70 

8,97 

2.87 

4. 99 

9-09 

3.5B 

4. 23 

■ 9,21 

4.30 

3. 57 

9.33 

5.02 

2.86 

9 . 46 

5.74 

5.24 

5.76 

0.48 

4,7 6 

5,31 

9,95 

4, 2 9 

5.86 

1.43 

3. 31 

- ■ 5.91 

1.91 

3. 33 

5,96 

. 2.39 

2. 36 

6.01 

2.37 

2.3 3 

■ 6.06 

3.34 

1, 9L 

6.12 

3-32 

3.93 

4.32 

0.36 

3. 57 

4,34 

0.72 

3.22 

4,37 

1.07 

2.86 

4 .40 

1.43 

2. 50 

4,43 

1.79 

2.15 

4.46 

2.15 

1.79 

4-48 

2.51 

1.43 

• . 4.51 

* 

CD 





obstacles. The appropriate fomixilae are, from equation (12), 


Majc Range = — : ■ ■ . (5T) 

^ sin P . v-'i / 

min 

■ . Min Range = ^ | ' 

max 

In practice these angle limits should be expanded somewhat, so that a 
number of range measurements to the terrain surrounding the boulder can. 
also be made (alter all, the edge detection algorltlims must compare 
range values on the terrain to those on the boulder in order to enhance 
the edge). The actual limits used in the simulation program for the 
four different test cases (as pictured in Figures 8, 10, 12, and l4) 
axe given in Table 3. ' 

In reality, the infoimation about the sixe and location of 
boulders to be detected will obvioxisly not bff. available. However, it 
may be possible to specify the limits on the location of obstacles in 
the mid-range field that we expect the laser rangefinder to be able to 
detect, and pick the limits on the angles to scan this entire field, 

While this type of scarming scheme will be suboptimal with respect- to 
the edge detection algorithms, it nonetheless respresents a first attempt 
at a physically realizable procedure. 

To siiriulate the situation where the angle limits are fixed so 
as to 'include any 1 meter radius boulder between 10 and 40 meters from 



the vehicle, the geometry of Figure 20 was defined. From this picture 
it is obvious that all smaller boulders, and some larger boulders, be- 
tween these limits will also be scanned, so that this type of scanning 
scheme is rather versatile. The scanning angle limits can now be de- 





TABLE 3 

Angle Limits Implemented for Variable Scanning 


DIST/\NCE 

RADIUS 

MAX BETA 

MIN BETA 

EXTREME THETA 

10- 

1^0 


0 

o 

o 

7^0° 

20 

1*0 

9.8® 

5*0® 

0 

o 

« 

30 

1*0 

6^6®‘ 

3*0® 

tJ 

♦ . 

o 

0 

40 

1*,0 

4 *.8® 

2*4® 

2.0° 




tertnined frau equations (53) through (56) "by substituting in the appro- 
priate values of b and r, i.e. 

(b = to, r = 1) = 2.86° (59) 

Pmax = 10, r = 1) = 18.1|3° (6o) 

0 ^ (b = 10, r = 1) = 5.T’*° . (61) 

iildJv 

0 . (b - 10, r =: 1) = - e (b = 10, r - 1) (62) 

n\in ' max.' ^ 

The four test bo\ilders (located at 10 m, 20 m, 30 ^^d 4 o in) were ‘then 

scanned by this inethod in simulations, and the edge detection algoritVmis 
applied, to arrive at the outlines shovm in Figures 21 through 24 
(which should be canpared to the outcomes of the variable scanning 
scheme illustrated in Figures 10, 12, 8, and l4 respectively). For 
boulders beyond the .20 m range the fixed scan technique is quite un- 
acceptable for the edge detection scheme, as the resulting boulder 
outlines are too incomplete to provide useful infomotion for path 
selection (except possibly as a go-no go indication of whether or, not 
there is some type of obstacle in the vehicle’s path of travel at the 
longer ranges). Once again, this problem will require further in- 
vestigation. 
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FIGURE 21 

ITie Boulder at 10 m - Fixed Scanning 
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FIGURE 22 

The Boulder at 20 in - Fixed Scanning 
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FIGURE) 23 

The Boulder at 30 - E'ixed Scanning 
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The Boulder at 4o m - Fixed Scaiinin^? 





7 . , SIMUIATION RESULTS FOR CRATERS 

Since the Rover will evidently encounter negative type obstacles 
(those extending below the terrain surface) as well as the positive type 
obstacles previously discussed, the edge detection scheme was tested on 
a representative obstacle from this second major class, A hemispherical 
crater of 1 meter radius, located 30 meters fran the Rover directly, in 
its path of trovel, was placed on the terrain, and the gecmetry necessary 
to obtain the range values was developed in a majincr similar to that for 
the boulder. As before, the steps in the edge detection scheme were then 
carried out. Figure 25 illustrates the resulting range images, both 
noiseless and noisy. In Figures 26 an.d 27 are the four alpha matrices 
necessary for selection of threshold values. Figure 28 shows the re- 
sults of applying both the Four Directional Ratio algorithm (with n = 2) 
and the Normalized Laplacian algorithm to the noisy range image. Finally, 
in Figure 2^, we see the outlines of the crater alt^er the thresholding 
operation has been carried out for the previous matrices. 

The striking feature of these pictures ' is tha-t only the near 
edge of the crater is detected; the far edge is missed, just as the 
bottom edge of the boulder was missed, and for the same reason. There- 
fore, if the botfcom edge problem of the boulder can be solved, then the 
far edge problem of. the crater will also be solved, so that the edge 
detection scheme will indeed be useiUl for both types of obstacles. 
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The Range Image for a Crater at 30 
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FIGURE 29 

Outlines of the Crater at 30 m 



SUMMARY AND CONCLUSIONS 


The research detailed in this paper was directed toward, the 
development of a practical obstacle detection system for the Mars Rover. 
A simple scheme was desired^, which woiild operate on the raw data ob- 
tained from the laser rangefinder mounted on the Rover in order to en- ' 
hance the outline of an obstacle in the vehicle’s path. 33y this means 
the size and location of the obstacle can' be deteimiined, and this in- 
formation used to make path selection decisions. Such a scheme was 
devised and simulated for a nuinber of typical obstacles; and the re- 
sults indicate that it has a high practical potential. Yet; as with 
any initial venture of this kind; as questions are answered even more 
questions are raised. Problems such as bottom edge detection and 
scanning scheme determination remain to be solved. Thus, this project 
should be seen as the first encouraging steps toward realization of 
the final operating system. 
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